Papers by H. Howie Huang
Don’t Judge a Language Model by Its Last Layer: Contrastive Learning with Layer-Wise Attention Pooling (2022.coling-1)
Copied to clipboard
| Challenge: | Recent pre-trained language models (PLMs) have shown competitive performance on many natural language processing tasks. |
| Approach: | They propose a pooling strategy which preserves layer-wise signals captured in each layer and learns digested linguistic features for downstream tasks. |
| Outcome: | The proposed method improves on standard semantic textual similarity and semantic search tasks. |
Improving Content Recommendation: Knowledge Graph-Based Semantic Contrastive Learning for Diversity and Cold-Start Users (2024.lrec-main)
Copied to clipboard
Yejin Kim, Scott Rome, Kevin Foley, Mayur Nankani, Rimon Melamed, Javier Morales, Abhay K. Yadav, Maria Peifer, Sardar Hamidian, H. Howie Huang
| Challenge: | Current approaches focus on improving ranking performance at the cost of escalating complexity and complicating the task. |
| Approach: | They propose a hybrid multi-task learning approach that trains on user-item and item-i item interactions. |
| Outcome: | The proposed approach improves accuracy, relevance, and diversity of user recommendations even for cold-start users. |
Prompts have evil twins (2024.emnlp-main)
Copied to clipboard
| Challenge: | We find that many natural-language prompts can be replaced by corresponding unintelligible prompts that provably elicit similar behavior in language models. |
| Approach: | They find that natural-language prompts can be replaced by corresponding unintelligible prompts that elicit similar behavior in language models. |
| Outcome: | The proposed prompts are obfuscated and uninterpretable but mimic the original natural-language prompts . the problem has applications of independent interest, the authors argue . |